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The Spacecraft Software Engineering Branch of NASA Johnson Space Center (JSC) provides 
world-class products, leadership, and technical expertise in software engineering, processes, 
technology, and systems management for human spaceflight. The branch contributes to major 
NASA programs (e.g. ISS, MPCV/Orion) with in-house software development and prime 
contractor oversight, and maintains the JSC Engineering Directorate CMMI rating for flight 
software development. Software engineering teams work with hardware developers, mission 
planners, and system operators to integrate flight vehicles, habitats, robotics, and other 
spacecraft elements. They seek to infuse automation and autonomy into missions, and apply 
new technologies to flight processor and computational architectures. This presentation will 
provide an overview of key software-related projects, software methodologies and tools, and 
technology pursuits of interest to the JSC Spacecraft Software Engineering Branch. 
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NASA Johnson Space Center (JSC) 


JSC is the heart of the operations, 
scientific, and engineering community 
that leads at the frontier of human 
space exploration, where technical 
challenges are most daunting and 
risks are highest 


Main Site: Houston, TX 
Civil Servants ~3100 
On/near site ~ 1 1 ,000 
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Spacecraft Software Branch (ER6) 



ER6 Responsibilities: 

— "GFE" Software for ISS and Other Customers 
— MPCV/Orion Software System Management and in-line 
software development 

— Software technology development and software for 
advanced projects 
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JSC ER6 Expertise Overview 


• Spacecraft Software Engineering Branch/ER6 is the 
Engineering Directorate's organization for: 

— Flight software systems engineering and integration (SE&I) 

• Full spectrum of spacecraft software functions, e.g.. 
Vehicle Systems Management (VSM), Command and Data 
Handling, Communications and Tracking, etc. 

— Software advanced technology development 



• Flight software SE&I accomplished via three organizing 
principles and related technologies 

— Robust, proven software architecture base 
— Detailed process definition and management 

• CMMI Maturity Level 3 Organization 

— Tools and technologies for reliable software implementation 
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JSC ER6 Software Expertise 

• Software Development 

• Flight and ground systems 

• Real-time, mission-critical, embedded software development 

• Software integration and hardware in-the-loop testing 

• Vehicle systems management 

• Fault detection, isolation and recovery software 

• Automation for human workload reduction 

• Flight safety enhancement 

• Resource management 

• Automation and Robotics 

• Hardware/software integration for human robotic systems 

• Teleoperation and autonomous system control 

• Automation for operations 
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JSC ER Software Expertise (Continued) 


• Software Testing and Simulation in conjunction with ER7 

• Advanced simulation environments allowing integration of 
software developed for many different platforms 

• Integration of multiple models into a single simulation 

• Real-time analysis 

• High-accuracy analysis 

• Software Project Management and Consulting 

• Experience on multiple complex spacecraft programs 

• Proven experience integrating across NASA organizations 

• CMMI compliant processes 

• Systems analysis 

• Software architecture for spacecraft within a larger system 




JSC ER Software Expertise (Continued) 



• Automation and Robotics 









JSC ER Software Expertise (Continued) 


• Software Simulation and Testing 



• Software Project Management and Consulting Services 


Figure 4.0 Project Lifecycle 







Spacecraft Software Engineering Branch (ER6) 
Current Projects and Activities 



• Software Engineering Leadership 

- EASEPG Chair ( 

— JSC SEPG Chair and rep to NASA 
software working group ( 

— JSC rep to NASA Mission Software 
Steering committee ( 

- EASSET-CMMI Level 3 

• MPCV/Orion System Management 

— Flight software 

- Software T&V / Kedalion 

— Vehicle System Management 

— Data integration & software tools and 
Processes ( 

— Simulation Software 

• GFE Software 

— ISS Simplified Aid for EVA Rescue 
(SAFER) 

— ISS Advanced Resistive Exercise Device 
(ARED) 

— ISS Countermeasures System Software 
(CMSS) 

— ISS LIDS/NDS (Low Impact Docking 
System / NASA Docking System) 

— ISS C2V2 formulation and oversight 


— ISS Tissue Equivalent Proportional 
Counter/ Advanced Radiation 
Instrument (TPEC/ARI) 

AES Software 

— Morpheus VTB 

— AEMU (Advanced Extravehicular 
Mobility Unit) 

— Deep Space Habitat 

— AMO (Advanced Mission Operations) 

— RadWorks/REM 

— RPM Lander 

— CATALYST 

— Core Flight Software 


STMD IR&D/Advanced Development 

— STMD Autonomous systems 

— Augmented Reality IR&D 

— Ontologies / Semantic search 

— E-Procedures 

— Intelligent system SE&I 

— MED prototype software 

— JSC institutional support software 
applications 
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Core Flight Software (CFS) Architecture 



Core Flight Software System 
Architectural Layers 


Mission Specific 
CFS Apps 


CFS Reusable 
Apps 


cFE (core Flight Executive) API 


Operating System Abstraction Layer 
(OSAL) API 


Platform Specific Package 
(PSP) 


Typical CFS Application Software Architecture 


Data To/From Vehicle 



9 Core Services 
0 Example CFS Reuse Apps 
Q Mission Specific Apps 
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Software Development Triad - Built upon Reuse 



Flight Software 
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Mission Specific System 
& I/O Models 

Dynamics, Time, 
Environment Models 

JEOD 


Generic Systems 
Models 

Valkyrie 



FLIGHT 

SYSTEM 


Trick Simulation Core (JSC) 
Linux OS 
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Tool Chain 


VMWare local PC/Mac) 

Eclipse (local IDE) 
CentOS/Linux (local vm os> 
GNU C/C++, Java (compile/XIate) 
Subversion (cm) 

Redmine (change tracker) 
Hudson (build checker) 



(code count metrics) 




Windriver Workbench (target ide/os) 
ParaSOft C++test (standards checker) 


Ground Software 


Displays & 
Controls 


TI 


Database 

(postgreSQL) 



Command & 
Data 

Dictionary 


ITOS Infrastructure (Goddard) 

(Data Com/Decom, Recon, Distribution, Display, 
Scripting, Recording, Post processing) 


Linux OS 
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Johnson Space Center 

Engineering Directorate 

Software, Robotics and Simulation Division 


Procedure Background 


Mission Operations: Overview 

- Crew operate equipment using procedures 

- Mission Control staff operate equipment 
remotely using procedures 

- Mission Control staff maintain operations 
schedules and plans 

- Staffing, equipment configuration and 
manifests also require scheduling and 
planning 


Hardware 




Procedure 



Schedule 


Plan 





Johnson Space Center 

Engineering Directorate 

Software, Robotics and Simulation Division 


Procedures are critical to 
conduct any complex 
operation 


Procedures contain knowledge 
about how to operate systems to 
achieve mission goals 


Procedures are the approved 
means by which a user operates 
a system 


Users of procedures include 
crew, flight controllers, 
instructors, mission designers, 
payload community, etc. 


Flight Procedure 
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Johnson Space Center 

Engineering Directorate 

Software, Robotics and Simulation Division 


Evolution of Procedures 





Apollo & Space Shuttle — Paper 




Current ISS— IPV/XML 
• No Automation or Computer 
Oversight 


Deep Space Exploration- AR-eProc; 
• PRL Extension 


• Machine Vision and Marker-less Registration 


Orion; Enhanced XML (PRL) 


• Computer Oversight 

• Automation 










Johnson Space Center 

Engineering Directorate 

Software, Robotics and Simulation Division 


Procedure Requirements 


• Need support for automating procedure execution 

- Commands and telemetry 

- Safety conditions/context 

- Explicit control structures 

• Don’t want to lose human readability 

- Capturing “look-and-feel” of current procedures 

- Presentation of procedure content in a human-friendly way 

• Improve quality of execution 

- Improved ease of use 

- Reduction of human error 

- Improved situational awareness 

• Interleave human actions with automated scripts 


Use Procedure Representation Language 

- Capture and formalized the above stated requirements 

- Started from NASA ODF standards and construct support automation 


Uses of PRL 
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IX 

NA SA 
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Advanced Procedure Authoring Tool 



• Full PRL features 

• Full PRL compliant 

• Drag-n-drop user interface 

• Leverage on web based & 
html5 technologies 

• Benefits 

— No executable download or 
plug-in installation require 

- Centralized application 
deployment 

- More robust media support 
from html5 better integration 
editing, viewing and execution 
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i Preview Publish 


Parameters 
Local Variables 


Copy Cut Pastf EPAT 0 . 2 . l 



Figure 1. DC Power Panel 
Is the LED Humina^ed'’ 

If the LED is not illuminated Then 

Command PDU 1A 1 B1 PI On 

Verify |n,M | [RIU1] PQIJ 1A 1 B1 PI STATUS - - PORTION 
Command SSLM 1A C 1 Light On 

Verify |TLM | [RIU1] SSLM 1A C 1 LIGHT ACTUATOR - IlGHT_ON ' 
Goto Step 2 

Camera Demo 


Properties 

Inputlnstruction 

Duration: 

Location: 

Crew Members: 
Double Space: 
Execution Mode: 


.* Add Comment 


v 

System Representation c™ a 
| j B • CTRLI 7 

controllef _ 
JJS5 controllef'— 
lav CTRL_SET_H 
j a + HSM_SET_HE 
HSM_SET_M( ▼ 


Add Instruction After fCmi- 

Rich Text 
(Description) 

[Add Text 

| [Add CenterName 
Add PredefinedMessage 


PUI Label: !!o! AIRLOCK. COMN 

Datatype: 


Add Hyperlink 
Add CONTROLLER HA 


Parameters and 
Variables 

Add Local Variable: <i . 


t NO_ERR (0) L 
t READ_ERR (1) 
t CHECKSUM_EF 
* COMM_ERR(3 


Selected Procedure Manual Instruction 
Add Call Procedure 044.01 Inputlnstruction 
[Add Request Procedure (H Manual Check Instruction 
Manual Verify Instruction 
Verify’ Instruction 
Verify Min-Max Instruction 
Ensure Instruction 
Manual Wait Instruction 
Wait Instruction 

3 Call Function Instruction 

Table 

Center On Go Instruction 
Itemized List 
Goto Step/SubStep 
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Procedure Viewer & Executor 


Google Glass - Focus on Mobility & AR-eProc- Focus on mixed reality 

mobile interactions interaction hands-free operation 

Capture Rich Procedure Content Once and Use It Everywhere 20 


AR-eProc- Focus on mixed reality 
interaction with tablet device 


Orion eProc-Flight Deck - focus 
on Edge Keys Display & 
Keyboard-less interaction 


\IG Remove lid of 
container slowly, as 
contents are under 
pressure and could burst! 

30 days ago 


TOCA Buffer Changeout Proc. 

Step 1 - Cover Removal 
Step 2 - QD Disconnect 
Step 3 - Buffer Removal 
Step 4 - Buffer Replacement 

30 days ago 










Augmented Reality Training Assistance 




The AR-eProc 
Vision 


Autonomous 

Operation 


AR ARED - Augmented reality 
Advanced Resistive Exercise 
Device Cylinder Evac. Procedure 


AR DSH Locator - Deep Space 
Hab augmented reality assets 
monitoring 


Technology Infusion 

• JSCIR&D 

• AES/AMO, OCT/AS 

• ISS DTO 

Technology Collaboration 

• Google / Glass Project 

• Methodist Hospital 


AR Ultrasound - 

Autonomous 

guidance 


AR TOCA - Augmented reality 
Total Organic Carbon Analyzer 
Buffer Change Out Procedure 
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Johnson Space Center 

Engineering Directorate 

Software, Robotics and Simulation Division 


Future Direction: Autonomous Operations 



1. Image detection software depiction of 2. Robonaut 2 being remotely guided through carotid 

anatomical landmarks which define an artery ultrasound imaging technique 

adequate carotid image superimposed over 
an actual carotid artery ultrasound image 
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Johnson space center SEATEST II: Just-in-time training & procedure execution 

Engineering Directorate J ° A 

Software, Robotics and Simulation Division with Glass 


Miniature Exercise Device (MED): 

a. Equipment Assembly Task 

b. Equipment Dis- Assembly Task 



Just-in-time (JIT) training of a Sani-tank 
purge 

After the task was completed using the 
Google Glass - the same JITT material was 
viewed on an iPad 


r 


Return 
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Johnson Space Center 

Engineering Directorate Augmented Reality to Enhance Crew Medical Training 

Software, Robotics and Simulation Division j 






Johnson Space Center 

Engineering Directorate 
Software, Robotics and Simulation Division 


Augmented Reality (AR-eProc ARED) 







/ Johnson Space Center 

Engineering Directorate 


Software, Robotics and Simulation Division 


Augmented Reality (AR-eProcTOCA) 


Johnson Space Center 

Engineering Directorate 

Software, Robotics and Simulation Division 


Orion Electronic Procedures 




Return 
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Johnson Space Center 

Engineering Directorate 
Software, Robotics and Simulation 


Intelligent Distributed Habitat 

Division QJ 


HDU Simulation 




i-Hab 



i-Hab PD 
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Johnson Space Center 

Engineering Directorate 

Software, Robotics and Simulation Division 


Other Projects 











ENGINEERING 
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Robonaut 2 on Centaur 2 








NATIONAL AERONAUTICS 
AMD SPACE ADMINISTRATION 
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ENGINEERING 

DIRECTORATE 


Virtual Reality Laboratory (VRL) 
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NATIONAL AERONAUTICS 
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SES On-orbit Simulation 
in the “Dome” 
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EA 


ENGINEERING 

DIRECTORATE 


MPCV/Orion Testing 
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ENGINEERING 

DIRECTORATE 


Miniature Exercise Device 


Miniature Exercise Device (MED) is a small, compact, lightweight 
exercise device that is capable of supporting high-intensity 
exercise for deep space missions 

Based on R2 joint technology ^ 

Utilizes torque control to manage cable resistance 
System capable of greater than 300 lbs of resistive force 
MED actuation system ~10 kg 
Proof-of-Concept testing successfully completed 
Supports customized exercise protocols 

Future work will incorporate EMG sensing to close exercise 
control loop around muscle activity 


NATIONAL AERONAUTICS 
AND SPACE ADMINISTRATION 




XI Exoskeleton 


• The XI is designed as an assistive 
walking aid for astronauts re- 
acclimating to gravity environment 
after long duration spaceflight 

- Post ISS long duration 

- Mars transit 

• XI capabilities have been expanded to 
provide exercise to crew during the 
mission 

• XI also functions as a dynamometer 
to assess changes in strength during 
spaceflight 

• XI is currently being expanded to 
include an upper body exoskeleton for 
similar benefits 



ENGINEERING 

DIRECTORATE 


NATIONAL AERONAUTICS 
AND SPACE ADMINISTRATE 




ARGOS 


Active Response Gravity Offload System Specs 
• Dimensions of Structure 41 ft x 24 ft x 1 8.5 ft 


Horizontal Travel 37 ft x 17 ft 

Vertical Travel 15 ft 

Offload Force [Max Payload Weight ?] 750 lbs 

Vertical Velocity of a 750 lbs load 4 ft/s 

Vertical Acceleration of a 750 lbs load 29 ft/s 2 

Vertical Velocity of a 250 lbs load 1 0 ft/s 

Vertical Acceleration of a 250 lbs load 88 ft/s 2 

Horizontal Velocity 9.8 ft/s 

Horizontal Acceleration 1 3 ft/s 2 


Active Response Gravity Offload System Applications 

• Micro G (ISS, LI , L2, Asteroids, HEO, Martian Moons) 

• Lunar G (Lunar Surface) 

• Mars G (Martian Surface) 

• Terrestrial Rehabilitation 





ENGINEERING 

DIRECTORATE 




NATIONAL AERONAUTICS 
AND SPACE ADMINISTRATION 






III., 


AERCam 



Automated Extravehicular 
Robotic Camera (AERCam) 


NATIONAL AERONAUTICS 
AND SPACE ADMINISTRATION 




ENGINEERING 

DIRECTORATE 
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Lunar Rover Prototype - Chariot 


NATIONAL AERONAUTICS 
AND SPACE ADMINISTRATION 
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Interest in Joining Us? 



Find out more about NASA JSC career entry options at: 


pathways.jsc.nasa.gov 

Current application period closes 26. September 2014 
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Johnson Space Center 

Engineering Directorate 

Software, Robotics and Simulation Division 


Backup 
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